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An excitable electronic circuit as a sensory neuron model 
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An electronic circuit device, inspired on the FitzHugh-Nagumo model of neuronal excitability, 
was constructed and shown to operate with characteristics compatible with those of biological 
sensory neurons. The nonlinear dynamical model of the electronics quantitatively reproduces the 
experimental observations on the circuit, including the Hopf bifurcation at the onset of tonic 
spiking. Moreover, we have implemented an analog noise generator as a source to study the 
variability of the spike trains. When the circuit is in the excitable regime, coherence resonance is 
observed. At sufficiently low noise intensity the spike trains have Poisson statistics, as in many 
biological neurons. The transfer function of the stochastic spike trains has a dynamic range of 
6 dB, close to experimental values for real olfactory receptor neurons. 
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1. Introduction 

Ever since the pioneering work of Hodgkin &: Huxleyl |l952 |. the biophysical mechanisms underlying the 
generation and propagation of action potentials (spikes) in neurons have been described with increasing 
detail, ranging from the discovery of new types of ion channels to the study of intracellular calcium 
dynamics [Hilk, 200ll ]. No matter how interesting, these new findings have helped little in our understanding 
of collective neuronal phenomena, which rema in a daunting task in face of the interplay among high- 
dimensionality, noise and nonlinearity (see e.g. Chialvd 2010l | for a recent review). The challenge should 



none theless b e faced: the solution of issues at th e frontiers of curren t -day n euroscience, like e.g. grandmother 
cell Barlow , [l972l versu s population coding [Young Yamand . Il992l |. or firing rate versus spike-time 
coding Rieke et al . 1999l | will likely be grounded on our success in this endeavor. 

In fact, theoretical progress in this front has been achieved in recent years with very simple models. 
One such examp le is the proposed solution for the century-old problem of the origin of psychophysical 



Copelli et al . 2002 : Kinouchi &: Copellil . 2006l |. Steven's psychophysical law states that 



response curves 

the psychological perception F of a physical stimulus (e.g. light, or odorant) of intensity /i is a power law 
F (X h^, with experimental values of the Stevens exponent s fluctuating around s ~ 0.5. Compared to 
a linear response, psychophysical nonlinear responses have at least one evolutionarily favorable property: 
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Fig. 1. Excitable electronic circuit. Va and Vh = —Va are the operational amplifier supply voltages. Vin is an input voltage, 
corresponding to an external stimulus. We describe the circuit as a two-dimensional dynamical system on the variables V- 
and Vout (see Eqs. ([2}). 



they amplify weaker stimulus, i. e. they have a larger dynamic range. But how do the Stevens exponents 
arise in the nervous system? 

At first, this question seems puzzling because single neurons typically have small dynamic 
ranges (Rospars et al . 2000]. A theoretical solution recently proposed involves a collective phenomenon: 
excitable waves are generated by the incoming stimuli and propagate "laterally" among excitable neu- 
rons, thereby amplifying the system response (in comparison to what would be observed in the absence 
of the coupling). Interestingly, this amplification mechanism is self-limited: under intense stimulation, for 
instance, a large number of excitable waves can be created, but owing to refractoriness they annihilate 
upon collision . The enhancement of dynamic range in this in odel is therefore governed by the low-stimulus 
amplification Copelli et oL . 20o3: Kinouchi Sz Copelli . 2006|. Robustness of these resul t s has been tested at 
differ ent modeling levels Copelli et al . 20051 : iRibeiro fc Copellil . l2008l : lAssis fc Copeiiil . l2008l : IPublio et all . 
[20091, showing that the degree of biophysical realis m in the model of each neuron is less relevant to the 
global dynamics than the topology of the network Copelli &: Kinouchil . 2005 : Copelli fc Campos . 2007 : 
Ribeiro fc Copelli l2008l: lAssis fc Copelli l2008l:lGollo et al\.\200^ This phenomenon has also been studied 



analvticallv fpurtlk o Copelli boo ' d: I we ^ et all I2OIII ] and was recently confirmed experimentally 



in cortical slices [Shew et al . 2009l |. 



The appeal of a sensory system with large dynamic range based on a network of simple excitable 
units, each with small dynamic range, goes beyond basic research in neuroscience. The idea could be 
rev ersed, leading to biologically inspired artificial sensors, which have been used in a variety of scenarios (see 



e.g. Ide Souza et al\ [19991] ). 



There are several electronic circuits reported in the literature which have been designed to present 
a neuron-like dynamical response. The rationale behind those efforts was to dynamically interact with 
biological neurons rather than stimulating them using response independent current commands. In this way, 
electronic circuits which analogically integrated the Hindmarsh and Rose equations jSzucs et adl2000l | were 
coupled to the neurons of a preparation of lobster pyloric CPG neurons. This allowed to show that regularity 
could emerge as a collective dynamical property of units which individually presented complex dynamics. 
In another set of experiments, electronic neurons interacting with a biological preparation were used to 
unveil which dynamical properties of a neural network depend on the bifurcation leading to excitation 
for the units, rather than on the details of the neural dynamics. To carry out this program, a standard 
form for class I excitable dynamics was analogically integrated with a circuit, whic h was used to replace 
a neuron in a midbody ganglion of the leech Hirudo medicinalis [Aliaga et al\ . 2003]. The responses under 
the stimulation of both the natural preparation and the one with a replaced neuron were found to be 
similar. Beyond the possibility of interacting with neurons through a dynamically sensible way, these efforts 
provide empirical support to the program of studying neural processes through simple and relatively low 
dimensional dynamical systems. Depending on the question under study, it might be desirable to be able to 
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establish a closer link between the device and a neu ron. In this spirit, a device implementing a conductance 
model was recently proposed jSitt fc Aliagal . 12007 ] . 

These circuits, however, have two limitations for our purposes. First, they are still too complex to be 
replicated in large scale. Second, they do not have a controllable noise source to produc e stochastic spike 
trairi s , a feature that is cornmon to the both mode l s ICopelli et al. . 2002] and real neurons Davan &: Abott . 
200 ll : Mainen &: Seinowski . 19951 : Petracchi et al , 19951 ]. The present work is a first step in this direction. 



We propose an excitable electronic circuit which can serve as a building block of an electronic sensor. The 
advantages of its extreme simplicity are twofold: it allows for scalability and, at the same time, simple 
mathematical modeling. 

The paper is organized as follows. In section [2l we describe the electronic circuit and the equations 
that model its dynamics. In section [3l we introduce noise from a simple analog noise generator at the input 
of the excitable circuit and study the statistical properties of the resulting spike trains and show that it 
can exhibit Poisson statistics as well as coherence resonance, as expected. In section [4] we evaluate the 
dynamic range of the excitable circuit and show that it is comparable to that of single sensor neurons. 



2. Dynamic model 

The circuit we propose is shown in Fig. [TJ It is composed of five resistors, one capacitor and one operational 
amplifier. The voltage Vin corresponds to an external stimulus, which can be e.g. a constant or the sum of 
DC and noise voltages. In our electronic neuron, the operational amplifier behaves as a simple comparator 
circuit, for which we use the following nonlinear model: 

dVout 



dt 



s sign [Vb - Vout + {Va - Vb)e{v+ - y_)] , (i) 



where is the Heaviside function and S is the op-amp slew rate (whose datasheet value for the simple 
TL071 in the circuit is S* = 16 V/s). As usual, symmetric supply voltages VJ, = —Va were used. 

Assuming i?3 ^ ii4, and applying Kirchhoff 's laws, we arrive at a two-dimensional dynamic model 
on the variables Vout and V^: 

^ = ^ sign [V - Vout + {Va - Vb)e{aVout - V.)] , (2a) 
at £ 

^ = ^ [f^^out + iVn - v.] . (2b) 

where a = Ri/{Ri + R2), /? = Ri/ (i?4 + R5) and 7 = R^/[Ri + R5). 14 = 10 V is a characteristic voltage 
of the same order of magnitude of the supply voltages, and we have defined e = Vd 5 as a characteristic 
(short) time scale. To avoid the possibility that the system ([2]) has more than one fixed point, we require 
/3 > a. In terms of the variables 

Vout /„ \ 

^; = — , (3a) 

- = (3b) 
the equations can be rewritten in dimensionless form 

V = sign \ b-v-\ — , (4a) 

w = (j) [/3v + 7j — w] , (4b) 
where we defined the dimensionless groups: 
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Fig. 2. a) Nullclines of system Q for a = 1, 6 = 1, a = 0.0909, /3 = 0.5, 7 = 0.5, j = 0, <^ = 0.01 and a;o = 9 x 10"^: 
solid black line for the v = Q nuUcline and dashed black line for the w = Q nuUcIine. The fixed point is unstable and the 
trajectories are attracted to a limit cycle (red solid line), b) Experimental limit cycle (black dots) and numerical integration 
of the model (red solid line) for xq = 1 x 10~^, Va = 10 V, 14 = — 10 V, = —6 V and = 5 x 10"'* (other parameters are 
the same as in (a)), c) Experimental frequency response / to the external DC stimulus Vin (black dots) and the same for the 
numerical integration of the model (red line), d) Comparison between experimental time series of Vout and V- (black circles 
and triangles, respectively) with numerical integration of the model (red and green lines, respectively), e) Experimental (black 
dots) and numerical (red line) spike trains obtained from the analog subtraction Vm of the dynamical variables (see text for 
details) . 



and replaced by the continuous function 

G(x;xo) 



1 



\ _|_ Q-x/xo 



(6) 



for the purpose of numerical integration and derivation (see below). Note that G — ?• as xq — s- 0. The 
constant (j) sets the ratio between the fast and slow time scale as in the FitzHugh-Nagumo model, so 
that -R3C ultimately controls the overall time scale of the problem. 

As shown in Fig. [2^ (black lines), the nullclines u = and zi; = of Eqs. resemble those of the 
FitzHugh-Nagumo model for neuronal excitability, with one fast [v or Vout) and one slow [w or V-) variable. 
In the limit xq — )■ 0, the cubic-like = nullcline becomes piecewise linear. When the fixed point sits at its 
outer branches, it is stable. It loses stability in a Hopf bifurcation as the w nullcline crosses the v nullcline 
at its central branch, so trajectories are attracted to a limit cycle (red line) with nonzero frequency / (i.e. 
/ changes discontinuously at th e bifur cation). Below the Hopf bifurcation, the circuit is said to be type-II 



excitable Rinzel &: Ermentrout . 19981 ]. 



There is good quantitative agreement between experimental data from the circuit and the numerical 
integration, as can be seen in Fig. [2]3, c, d and e. Note that through an analog subtraction Vm = 1.5^- — 
Q.QilVout (see also Fig. [3b) the circuit exhibits the spikes typical of neuronal membrane potentials (Fig. [2^). 
We emphasize that in Fig. [2] experimental and numerical data agree without any fitting parameter, as long 
as xo is sufficiently small (< 10~^). 



3. Noise addition and coherence resonance 

So far we have discussed the response of the excitable circuit under DC stimulation. Biological neurons, 
however, can show highly variable responses, even when subjected to a presumably constant stimulus. 
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Fig. 3. a) An analog noise generator based on the amplification of transistors tliermal noise. Noise amplification is given 
hy A = [(-R^i + Ra'i)/ RAl]{RAi/ Ras)- b) Block diagram of the circuit used to verify the excitability of the circuit pre- 
sente d in Fig. [1] Analog addition and subtraction (see text for details) are performed with standard TL074 op-amp opera- 
tions [Senturia fc Wedlockl. Il98ll ]. 
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Fig. 4. a) Numerical phase plane trajectory (red line) due to noise excitation. Without noise the system would stay in a 
resting state at the fixed point (white dot). Experimental (b) and numerical (c) spike train series are shown when the system 
is in the excitable state (stable fixed point as shown in (a)), d) Experimental coherence resonance curve for C = 50 pF, 
Va = 12 V = — Vb and V]jc = —7.826 V (see Fig. [ij. Each point corresponds to an average over 10 s time series. 



Examples range from hi ghly variable r e spons es olfactory receptor neurons (ORNs) to presentation of iden- 



tical puffs of odorants [Rospars et al\. l200Cl[ | , to c ortical cells stimulated with a constant current via an 



intr Jellula. electrode ^liSSIte 



In an attempt to endow our excitable circuits with the 
variability in the spike trains observed in biological neurons, we propose the simple analog noise generator 
shown in Fig. [3ti. Once more, its simplicity allows one to attach independent noise generators to each 
excitable circuit when connecting them in a network. 

The circuit in Fig. [3^1 provides a two-stage amplification control via two operational amplifiers to the 
thermal noise produced by the KN2222 transistors. Its output voltage Vnoise is approximately a Gaussian 
white noise voltage with a cutoff frequency around 1 kHz. 

To obtain variable spike trains, the stimulus Vin consists in the analog addition of Vdc and Vnoise (see 
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blocks 1 and 2 in Fig. [8)3). In the model, this corresponds to replacing Eq. (jDa) with 

w = (p[l3v + 7j + DC{t) - w] , (7) 

where D grows linearly with the gain in the noise amplification A (which in turn is controlled by the 
variable resistors shown in Fig. [3]). 

Setting Vdc below the Hopf bifurcation, the circuit sits at a stable fixed point at the right branch of 
the V = nullcline, from which it eventually departs owing to noise (Fig. [4^). This generates spike trains 
with variable interspike intervals tp, as shown in Fig. [4)3 and c. 

We now show that the interp lay between noise and excitability behaves as expected in our simple 
circuits. iPikovskv fc Kurthsl 1997l | have shown that the coherence the spike train of the FitzHugh-Nagumo 
model peaks at an intermediate noise value, in a phenomenon which has been called "coherence resonance" . 
In other words, the normalized standard deviation 



Rp = 



(8) 



should have a minimum as a function of the noise intensity. This is precisely what we observe in our circuit 
when Vdc (= —7.826 V) is close to the Hopf bifurcation {Vuopf = —7.82 V), as displayed in Fig. Hli. Note 
that Rp close to zero means that the time series is approximately periodic. 

For small noise amplitudes iVnoise ~ 50 mV, or ^4 ~ 0{1) in Fig. [Hi), spikes are sparse and Rp 
approaches unity. This suggests a Poisson process in which the interspike interval distribution approaches 
an exponential 

P(tp) = re-'■*^ (9) 
where r is tir ne rate constant. This Poisson limit is i r iteres ting because it is observed in different neuronal 



preparations 
of the small Vnoise regime. 



Davan fc Abottl . l2nnil : IPetracchi eroZI . Il995l ]. so we performed a detailed statistical analysis 
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Fig. 5. Spike train statistics of a 100 s duration series from the circuit of Fig. [Sja. a) Interspike interval (isi) accumulated 
distribution in log- linear scale. Inset: corresponding histogram of isi. The dashed line corresponds to an exponential fit of a 
Poisson distribution with mean firing rate r = 10.0(3) s~^. The deviation from the Poisson distribution for small isi is due to 
the refractoriness of the excitable circuit. In the following graphs we have divided the series in time windows of duration T. 
The mean number of spikes (n) (b) and the variance (c) are shown as functions of T. In (d) we have as a function of 
(n). The dashed lines are fits of = (n) = rT according to the Poisson distribution. 
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In Fig. [5^ the statistics of a 100 s experimental time series was compared to the accumulated distri- 
bution 

/oo 
re-''^''dtp = e-'-\ (10) 

showing good agreement for a fitted rate r ~ 10.0(3) s~^. To check for consistency, we divided the time 
series in small time windows of size T and sampled the number n of of spikes per window. In a Poisson 
process one has the linear relationships (n) = rT, = (n^) — (n)^ = rT which are confirmed in Fig. [5]3 
and c. The unit slope in the cr^ versus (n) plot is also verified (see Fig. [Sji). These results show that our 
circuit can be used to mimic not only deterministic dynamics, but also simple statistical properties which 
appear in biological neurons. 



4. Dynamic range 

In this section we study the response of our excitable system to varying input voltage Vdc considering the 
noise amplitude Vnoise constant. Although in real neurons the background noise may have a dependence 
on the stimulus, it is a fair approximation to treat the noise amplitude as constant and focus on the 
dependence on input signal as a control parameter of the dynamics. In what follows, the response of the 
circuit is defined as the mean firing rate F measured over a fixed time interval T^. This so-called "rate 
codin." is also a longstanding approximation \^^^, which seems to fit data in several cases f^ . 
19991 : lArbibl . l2002l |. 

For fixed Tm and noise amplification the response F of our circuit is an increasing function of the 
stimulus Vdc because larger values of Vdc amounts to increased excitability, lowering the "effec tive thresh- 
old" to noise- induced spike generation (there is no real threshold in type-II excitable neurons jlzhikevichl . 
2003l). Conversely, for fixed VdCj the response F also increases with increasing noise intensity A. These 
results are shown in Fig. [6^, where we plot (for different noise intensities) the responses -F(Vdc) of our 
excitable circuit with a 1 nF capacitor. This choice sets the time scale of the neuron in the millisecond 
range (i.e. that of biological neurons). Note that in the absence of noise [A = 0) the response is null up to 
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Fig. 6. Experimental response curves FiVoc) rneasured at different values of the noise amplification A. Supply voltages 
Va = l2V = -14. a) C = 1 nF (0 = 5 X fO""* and Tm = 10 s). b) C = 50 pF {<f> = 0.01 and Tm = 0.2 s). c) Response curve 
for C = 1 uF (A=1000), and relevant parameter for calculating the dynamic range, d) Dynamic range as function of noise 
amplification for C = 50 pF (black squares) and C = 1 nF (white circles). 
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the Hopf bifurcation (so the lowest curve in Fig. [6^ is similar to Fig. [2J3) . 

Results in Fig. [Hb correspond to a circuit with a 50 pF capacitor. This single change renders a much 
faster circuit, now operating in the microsecond range, but with its dynamical features otherwise preserved. 
This has potential applications, because a faster circuit requires shorter measurement intervals Tm (=0.2 s 
in our example) for a reliable estimation of the firing rate. 

Given a response curve, we can calculate its dynamic range, which roughly speaking corresponds to 
the range of stimulus intensity that t he fir i ng rate can "appropriately code" . Measured in decibels, this is 
arbitrarily defined as Rospars et ai . 200d : Copelli &: Kinouchi . 2005l | 



10 log 



10 



V* 

V* 



(11) 



where V* = Vx — Vq are measured relative to the voltage Vq at which the response becomes non-zero and 



F{V.,) = xF„ 



(0 < X < 1) 



(12) 



where Fmax is the firing rate at the Hopf bifurcation. In words (see Fig. [6h), A measures the range of 
stimulus Vdc which are neither too small (Vdc < ^0.1) to go undetected nor too close {Vdc > V0.9) to the 
autonomous oscillations that emerge at VHopf- 

As shown in Fig. (6)1, the dynamic range is a rather robust feature of our excitable circuit: it 
changes little as the noise intensity is varied, regardless of the time scale at which it operates. In 
both cases, A ~ 6 d B, which is closer to the values obtained experimentally (A ~ 10 dB for olfao 



tory sensory neurons Rospars et al . 2000], A ~ 14 dB for retinal ganglion cells [Peans et al . 2002 



iFurtado fc: Copelli . 2006|) than results obtained theoretical ly for discrete inodels of excitable elements 
(A - 14 dB in [Furtado k Copellil . 120061 ] and A ~ 19 dB in jAssis Copeliil . I2OO8I ] ) . 



5. Concluding remarks 

In summary, we have presented an excitable electronic circuit whose simplicity allows for scalability and 
accurate mathematical modeling. Its dynamical equations lead to time series which quantitatively reproduce 
experimental results without fitting parameters. 

In addition, we have shown that the introduction of noise from a simple analog noise generator at 
the input of the circuit produces variable spike trains. The statistics of the interspike intervals is shown 
to exhibit coherence resonance. Furthermore, by analyzing long time series under low noise intensity, the 
spike trains were shown to behave as a Poisson process, like some biological neurons. 

In the excitable regime, with fixed noise amplitude, the firing rate response of the system to a Vdc 
input - the stimulus - was shown to have a dynamic range of about 6 dB, which is also comparable to 
some biological sensory neurons. Together with its scalability, these properties render the system a potential 
building block for artificial sensors based on collective properties of excitable media. 
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